Multimodal Meaning Representation for Generic Dialogue Systems Architectures

نویسندگان

  • Frédéric Landragin
  • Alexandre Denis
  • Annalisa Ricci
  • Laurent Romary
چکیده

An unified language for the communicative acts between agents is essential for the design of multi-agents architectures. Whatever the type of interaction (linguistic, multimodal, including particular aspects such as force feedback), whatever the type of application (command dialogue, request dialogue, database querying), the concepts are common and we need a generic meta-model. In order to tend towards task-independent systems, we need to clarify the modules parameterization procedures. In this paper, we focus on the characteristics of a meta-model designed to represent meaning in linguistic and multimodal applications. This meta-model is called MMIL for MultiModal Interface Language, and has first been specified in the framework of the IST MIAMM European project. What we want to test here is how relevant is MMIL for a completely different context (a different task, a different interaction type, a different linguistic domain). We detail the exploitation of MMIL in the framework of the IST OZONE European project, and we draw the conclusions on the role of MMIL in the parameterization of task-independent dialogue managers.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Multimodal and Multimedia Systems: Architectures for Advanced Dialogue

Multimodal systems use a single meaning representation language for all information and choose the effective way to present this for a specific user at a point in task performance through the available media. In contrast, many multi-media systems retrieve information stored in media specific representations which constrain the presentation options. This paper investigates the trade-off of stora...

متن کامل

A Robust and Generic Discourse Model for Multimodal Dialogue

We present an implemented, well-tested discourse model used in several monoas well as multimodal dialog systems. We provide a detailed description of the underlying representation and show how such challenging phenomena like cross-modal anaphoric expressions and ellipses are processed.

متن کامل

Enhancing Multimedia Interfaces with Intelligence

Current software products such as spreadsheets are beginning to include automated graphical design and input checking heuristics to provide added automated functionality. The use of such rules requires higher levels of abstract meaning representation than raw media. They also rely upon representing contextual information describing the domain, task, user and current dialogue. With these technol...

متن کامل

Corega Tabs: Incremental Semantic Composition

In parsing natural language, incremental semantics composition is one of the most prominent issues. In the past, numerous approaches have been developed for assigning meaning to noun and verbal phrases and their complements and modifiers. Often, their inferential power is too low for practical applications or the expressiveness of the representation language leads to intractable inference proce...

متن کامل

Graphical and Linguistic Dialogue for Intelligent Multimodal Systems

In this paper a brief outline of the elements of a theory of multimodal representation and interpretation is presented. The theory is illustrated with the help of an interactive system called GRAFLOG which is able to support a multimodal graphical and linguistic dialogue. In this dialogue graphical symbols with their interpretation are introduced incrementally, and the system is able to assist ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • CoRR

دوره abs/cs/0703091  شماره 

صفحات  -

تاریخ انتشار 2004